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Abstract 

It  is  well  known  that  if  A  and  B  are  two  positive  definite  matrices  of  the 
same  order  and  0  A  ^ 1 ,  then  : 

—1  ^—1  —I 

[-\A+a-A)B]  •^+(1-A)B  . 


It  is  easy  to  construct  an  example  consisting  of  two  positive  semi-deflnlte  matrices 
for  which  the  above  inequality  is  not  true  when  one  replaces  the  Inverse  operation 
by  Moore-Penrose  Inverse  operation.  In  this  paper,  we  glve^^necessary  and  sufficient 

conditions  for  the  validity  of -the  inequality  ^  ^  ' 

’ . - 

(\a+  (l-A)Br  <  AA'*'+  (1-A)b‘'’ 


for  every  O^A^l.  As  an  application,  we  give  a  sufficient  condition  under  which 
the  inequality  (EA)*^^  ECA*^)  is  valid,  where  A  is  a  square  matrix  of  random  variables 
which  is  almost  surely  positive  seml-definlte,  generalizing  the  well-known  result 
(EA)  ^^EA  ^  when  A  is  almost  surely  positive  definite. 
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1.  Introduction: 


Fedorov  (1972,  Theorem  1.1.12,  p.  19)  states  that  if  A  and  B  are  positive 
definite  matrices  and  O^X^l  is  any  real  number,  then 

[XA+  (l-X)B]~^j<  XA~^+  (1-X)b"^.  (1) 

(We  say  that,  for  two  square  matrices  C  and  D  of  the  same  order,  C<  D  if  D-  C  is 
positive  semi -definite.)  For  a  proof  of  this  inequality,  see  Moore  (1973,  p.  408) 
or  Marshall  and  Olkin  (1979,  pp.  469-471). 

The  above  inequality  is  useful  in  optimal  designs  and,  especially,  in  linear 
optimal  designs.  This  inequality  is  used  in  Lemma  2.9.1  of  Fedorov  (1972,  p.  123], 
Let  V  be  the  collection  of  all  square  matrices  of  order  q  and  L  a  real  linear  func¬ 
tional  on  V,  i.e.. 


and 


Assume , 


further. 


L(A+B)  -  L(A)  +  L(B)  for  every  A, Be  V, 

L(cA) «  cL(A)  for  every  c  real  and  Ae  V, 
that 


(2) 

(3) 


L(A)^0  if  A  is  positive  seml-deflnlte.  (4) 

Consider  an  optimal  design  problem  involving  q  parameters.  Let M  be  the  collection 
of  all  information  matrices  and  the  collection  of  all  non-singular  Information 
matrices.  Let  L  be  a  linear  functional  satisfying  the  above  three  conditions. 

Lemma  2.9.1  of  Fedorov  [1972,  p,  123]  says  that  the  function 


L^; 


-1 


defined  by  Lj^(M)“L(M  )  ,  Me  is  a  convex  function  on  Mj^,  i.e. 


L^XMj^+  (1-X)M2]  <  XLj^(Mj^)+  (l-X)L^ai2) 


for  any  M26  and  O^X^l,  This  is  a  simple  consequence  of  the  inequality  (1) 
and  the  conditions  (2) ,  (3)  and  (4) . 

In  Remark  1  on  page  124,  Fedorov  comments  that  if  MeM  is  singular,  one  can 
consider  Moore-Penrose  Inverse  of  M  and  define  LCm"*").  See  also  Remark  1 

to  Theorem  2.7.1.  In  other  words,  if  we  define  M  -►  R  by 

L^(M)  “  L(m"^)  ,  m"^  being  the  Mbore-Penrose  of  M,  MeM, 

his  remarks  seem  to  mean  that  is  a  convex  function  on  M .  We  show  that  this  is 
not  true  in  general. 

In  this  connection,  we  ask  the  following  question.  Let  A  and  B  be  two  posi¬ 
tive  semi -definite  matrices  of  the  same  order  and  O^X^l  be  any  real  number.  Is 
the  inequality 

[XA+  (1-X)B]‘^<  Xa‘'‘+  a-X)B‘'",  (5) 


analogous  to  (1) ,  true? 

The  organization  of  this  paper  is  as  follows.  In  Section  2,  we  give  a  necessary 
and  sufficient  condition  for  (5)  to  be  valid  for  every  O^X^l.  In  Section  3,  we 
we  study  this  inequality  in  the  context  of  a  collection  of  positive  seml-deflnite 

matrices  Indexed  by  a  probability  space.  In  particular,  we  examine  under  what  con- 

+  +  * 
dltlons  (EA)  ^EA  when  A  is  a  symmetric  matrix  of  random  variables  such  that  A  is 

almost  surely  positive  semi-deflnlte. 

For  any  matrix  A,  range  of  A  is  defined  to  be  the  linear  space  spanned  by  the 
columns  of  A  and  it  is  denoted  by  R(A) .  A  denotes  an  arbitrary  g-inverse  of  A,  i.e. 
a  matrix  satsifying  AA  A  ~  A.  For  basic  ideas  concerning  Moore-Penrose  Inverse, 
see  Rao  and  Mltra  (1971,  pp  50-53). 
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2.  Convexity  of  the  Moore-Penrose  Inverse; 


The  following  result  gives  conditions  under  which  (5)  holds  for  every  O^A^l. 


Theorem  1.  Let  A  and  B  be  two  real  positive  semi -definite  matrices  of  the  same 
order.  Then  the  following  are  equivalent: 


(i)  R(A)  -  R(B)  . 


(ii)  There  exist  positive  semi -definite  g-inverses  A  and  B  of  A  and  B  re¬ 
spectively  such  that  [XA+  (l-X)B]  ^ XA  +  C1-X)B”  for  some  positive  semi -def intie 
g-inverse  [XA+  (l-X)B]  of  XA+  (l-X)B  and  for  every  O^X^l. 

(iii)  [XA+  (1-X)B]^£  Xa'*'+  Cl-X)B^  for  every  0£X£l. 

Proof;  The  proof  of  (i)  *>  (ill)  is  similar  to  the  proof  of  the  remark  in  Glovagnoll 

T 

and  Wynn  (1985,  p.  129).  Let  P  be  an  orthogonal  matrix  such  that  A“  P  diag(A^,0)P  , 
where  A^^  is  a  diagonal  positive  definite  matrix.  When  R(A)  *  R  (B) ,  we  then  have 
B  =  P  diag(Bj^,0)P  where  B^^  is  positive  definite.  To  show  that  (iii)  holds,  we 
have  to  show  that  [XAj^+  (l-X)Bj^]  ^ 
are  positive  definite,  (iii)  •>  (ii)  is  obvious.  We  bhall  now  prove  (ii)  ■>  (i) . 
Suppose  [XA+  Cl“X)B)l  _<  Xa”+  (1-X)b"  for  positive  semi-definite  g-inverses  a”  and 
B  (Independent  of  X)  and  a  positive  semi-deflnlte  g-inverse  [XA+  C1“X)B]  for 
every  X  as  specified  in  the  theorem.  Premultiply  and  postmultiply  the  above  by 
XA  +  (l-X)B  yielding  XA+  (l-XlB^  [XA+  C1-X)B][XA"+  (1-X)b"][XA+  (1-X)B]. 

If  R(A)j*RCB).,  assume  without  loss  of  generality  that  R(A)  is  not  contained  in  R(B), 
in  which  case  there  exists  a  vector  b  satisfying  Abft  0  and  Bb  =  0,  Premultiplying 

and  postmultiplylng  the  above  inequality  by  b  and  b  respectively  lead  to 

T3T2  T*“  T  T^T 

Xb  Abj^X  b  Ab+ X  (l-X)b  AB  Ab  or  equivalently  b  Ab£X(,b  AB  Ab-b  Ab),  when  0<  X<  1. 

T 

But,  since  b  Ab>  0,  the  above  inequality  cannot  hold  for  all  0 <  X <  1.  This  completes 
the  proof. 


£XA^^+  C1-^)B^^,  which  is  true  since  A^^  and  Bj^ 


Remark  1.  From  Theorem  1  it  follows  that  when  A  is  positive semi-deflnlte  the  func¬ 
tion  A-»-  A^  is  matrix  convex  iff  A  varies  over  a  set  of  posltlveseml-def Inlte  matrices 


with  the  same  range.  The  ’if’  part  of  this  assertion  is  proved  in  Glovagnoll  and 
Wynn  (1985) . 

Remark  2.  For  a  given  \  with  0  <  X  <  1,  one  can  always  find  positive  seml-deflnlte 

g-inverses  [XA+(1-X)B]",  a“  and  B"  (depending  on  X)  and  satisfying  [XA+(1-X)B]“ 

^  XA  +  (l-X)B  even  though  RCA)  and  R(B)  are  different.  This  could  be  seen  as 

T 

follows.  Let  P  be  a  nonsingular  matrix  satisfying  A  •  P  dlag(A^,d2,QlO)P  and 

T 

B  ■  P  dlag(D^,0,D2>0)P  where  Aj^,A2»D^»D2  are  diagonal  positive  definite  matrices. 

The  existence  of  such  a  P  is  guaranteed  by  Theorem  6.2.3  in  Rao  and  Ultra  (1971). 

For  a  given  0<  X<  1,  consider  the  g-inverses  [XA+(1-X)B]“  -  (P^)"^diag[ (XAj^+(l-X  )“^, 
(XA2)"^,((1-X)D2)"^,0]p"^.  a'  -  CP^)“^diagCA"h2^,M.0)P“^  and  B"-(p^)~ldlag(D“W,D2}0)P 
where  M  and  N  are  positive  seml-deflnlte  matrices  satisfying  (1^2)”^^ N+  1^2^  and 
((1“X)D2)  (1-X)D2^.  With  such  a  choice  of  M  and  N,  it  can  be  verified  that 

[XA+  (1-X)B]"<  Xa"+  (1-X)B". 


Corollary  1.  Let  . Aj^  be  k  real  positive  semi-definite  matrices.  Then 

(Xj^Aj^+. .  .+X^Aj^)  for  every  X^  satisfying  O^X^^l  (i*  1,2 . k) 

and  y  X  -  1  iff  R(A.)  -  R(AJ  for  i,J  -  1,2 . k. 

i-1  ^  J 

Proof.  We  shall  prove  the  result  for  k«  3.  The  proof  in  the  general  case  follows 
along  similar  lines,  by  induction.  Assume  X.  <  1,  R(A. )  ■  R(A-)  -  R(A_) .  Then 

-  tx^Ai»<l-X^)(3:^  *2  *  Aj  +  ^  Aj)* 

X-  x_ 

(applying  Theorem  1).  Since  TIT"  *  applying  Theorem  1  again,  we  get 

^  X  ^  X 

(XjAj+  XjAj+  XjAj)*^ XjA^+  (1-X^)  +  TTiq  A^l  -  >'1*^+  ^2*2* 

eludes  the  proof  of  the  ’if’  part.-  To  prove  the  'only  if  part,  choose  X^  -  0.  Then 

from  Theorem  1,  we  get  R(Aj^)  ■  R(A2)a  Similarly  R(A^)  ■  R(Aj)  for  all  i,j. 

Corollary  2.  Let  A^,  n^l  be  a  sequence  of  positive  semi-definite  matrices  and  X^, 
n>  1  be  a  sequence  of  nonnegative  real  numbers  such  that  (i)  ^  ^  I  ^iN 

“  +  ill  ill 

converges  (iii)  J  converges.  Then  (  \  X.A.)  1  ^  ^i^l  for  every  such  ••‘loanee  X^ 

i>l  ^  ^  i>l  i>l 


n>  1  iff  ia  same  for  all  n^l< 
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Proof.  The  'only  if  part  is  proved  as  in  Corollary  1.  To  prove  the  'if  part, 

n 

assume  that  R(A.)  is  the  same  for  all  1.  Let  B  ■  ^XjA.  and  B  ■  ^  X.A  .  Let  C 

^  “  i-1  ^  n  i^l 

be  a  matrix  having  the  same  range  as  the  A. 's  and  let  6  ■  1  -  ^  X . •  If  we  assume 

I  “  i-1  ^ 

that  at  least  one  X^  is  positive  Cl^i^)  ia  then  "  ^(®)  •  Since 

B  as  n^®,  following  the  argisnent  given  in  Stewart  (1969,  p.  34)  Csee  also 
Campbell  and  Ifeyer,  1979,  Chapter  10),  we  see  that  (B^+ d^C)"*"-*- b"*"  as  n-+-».  Applying 
Corollary  1,  we  get  (B^+ d^C)"*"^  Xj^A^+. .  .+X^A^+ d^C"*".  The  result  now  follows  by 
taking  limits  as  n-^“. 

Remark  3.  The  results  in  this  section  proved  for  real  s}nDmetrlc  positive  seml-deflnite 
matrices  are  also  valid  for  complex  hermltian  positive  semi-definite  matrices,  with 
obvious  modifications  in  the  proofs. 


Some  Extensions  and  Applications; 


In  this  section,  we  consider  the  problem  of  extending  the  Inequality  specialized 
in  Seciton  2  for  a  collection  of  positive  semi-definite  matrices  indexed  by  a 
probability  space. 

Let  (Y,8,u)  be  a  probability  space  and  A^,  ye  Y  a  collection  of  positive  semi- 
definite  matrices  of  the  same  order.  Let  A^.  ■  (Ca^jy)),  and  ye  Y.  Assume 

that  *  function  of  y  is  measurable  for  every  l^it  There  are  three 

basic  questions  one  can  ask  in  this  connection. 

(a)  Let  Ay  ■  I®  ^ijY  **  *  function  of  y  measurable 

for  every  lf.i,  j^n? 

(b)  If  the  answer  to  (a)  is  affirmative  and  each  ®^jy  I®  Integrable  with 
respect  to  the  measure  u,  is  each  ^j^jy  integrable  with  respect  to  u? 

(c)  If  the  answers  to  (a)  and  (b)  are  affirmative,  is  the  inequality 

(  A  uCdy))"^  ^  [  A\(dy) 

/  y  ^  ^  y  ^ 


true? 
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We,  first,  tackle  (a).  We  give  two  sets  of  sufficient  conditions  under  which 
A***  as  a  function  of  y  is  measurable. 

y 

Theorem  2. 

(a)  Suppose  R(A^)  is  the  same  for  all  ye  D  e  B  with  vi(D)  ■  1.  Then 
as  a  function  of  y  is  measurable. 

(b)  Suppose  Y  is  a  topological  space  and  B  is  some  a-field  on  Y  containing 
all  open  subsets  of  Y.  Suppose  R(Ay)  is  the  same  for  all  y  in  Y. 

I  f  Ay— as  a  function  of  y(  is  continuous ,  then  A^  as  a  function  of  y  is 
continuous. 

Proof;  Let  A  be  any  symmetric  matrix  with  R(A  )  ■  R(A)  for  every  y  in  D.  There 

T 

exists  an  orthogonal  matrix  P  such  that  PAP  >  diag(A^,0),  where  A^  is  a  diagonal 

matrix  with  diagonal  entries  being  the  non-zero  eigen  values  of  A.  Since  Range 

T 

(Ay)  ■  Range  (A),  ye  D,  P  AyP  -  diag  (A  ^,0)  for  some  nonsingular  matrix  Ay^ 

^  +  T  -1 

which  is  of  same  order  as  A^.  Note  that  Ay  ■  P  diag((Ay^)  ,0)P.  If  Ay  as  a  func¬ 
tion  of  y  is  measurable  (continuous)  so  is  Ay^  as  a  function  of  y.  Consequently, 
(Ay^)  ^  as  a  function  of  y  is  measurable  (continuous) .  Hence  Ay  as  a  function 
of  y  is  measurable  (continuous). 

Theorem  3. 


(a)  Suppose  there  exists  a  set  De  B  such  that  y(D)~  1  and  A  A  >  A  A 

^  Yi  72  yz  yi 

for  every  yj^»y2^  Then  Ay  as  a  function  of  y  is  measurable. 

(b)  Suppose  Y  is  a  topological  space  and  B  is  a  a-field  on  Y  containing  all  open 


subsets  of  Y,  Suppose  A  A  ■  A  A  for  all  y, ,y-€  Y.  If  A  as  a  func- 

^1  ^2  ^  ^2  ^1  ^ 
ti«an  y  is  continuous,'  then- Ay  as  a  function  of  y  is  continuous. 

We  need  the  following  lemma  in  the  proof  of  the  above  theorem. 

Lemma  1.  Let  {Ay!  ye  Y}  be  a  family  of  pairwise  commuting  symmetric  matrices  of 

order  nxn.  Then  there  exists  an  orthogonal  matrix  C  such  that 


J  •**  »*"*  •"*  •**  WV  V*?  VV  •*' 
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C  A  C  =  diag{X  ,X  ,...,X  }, 

y  ®  ly’  2y  ny  * 

where  X,  ,X-  ,...,X  are  the  eigenvalues  of  A 
ly  2y  ny  *  y 

Proof :  This  result  Is  well  known  when  Y  is  finite.  See, for  example,  Rao  (1973, 

Exercise  15,  p.  72).  Let Q be  the  least  ordinal  number  corresponding  to  the  cardinal 

number  of  Y.  n  is  obviously  a  limit  ordinal.  See  Kamke  (1950) , 

Let  us  identify  Y  with  [0,0).  In  other  words,  the  given  family  of  matrices  can 

be  written  down  as  a  generalized  sequence  Aq,A^,A2, . . . ,A^, . . , ,  a<  0. 

We  claim  that  there  exists  a  vector  of  unit  length  such  that  it  is  an 

eigenvector  for  every  A^  a<Q.  For  this,  we  proceed  as  follows. 

Let  Xj^Q  be  any  eigenvalue  of  Aq.  Let  0<  a<0  be  any  ordinal  number.  Then,  there 

exists  a  vector  x^°*^  of  unit  length  and  real  numbers  X  ,  8<a,  satisfying  the  follow- 

13 

ing  properties. 

(i)  Xj-  is  an  eigenvalue  of  A-  for  every  0£6<a. 


(li)  Agx' 


X^  x^  ''  for  every  0_<8<o. 


(iii)  X,  ,  0<  8<  a  does  not  depend  on  a. 

(ci) 

This  x^  is  obtained  by  transfinlte  induction  as  follows. 

There  exists  a  vector  x^^^  of  unit  length  such  that  AqX^^^  =  X^^^x^^^  Note  that 

A^x^^\  A^x^^\...  are  eigenvectors  of  Aq  corresponding  to  the  same  eigenvalue  X^^q. 

Consequently,  every  vector  in  the  linear  manifold  spanned  by  {x^^\ A^x^^\a^x^^\  . . } 

is  an  eigenvector  of  Aq  corresponding  to  the  eigenvalue  This  linear  manifold 

contains  an  eigenvector  of  A^.  See  Rao  (1973,  p.  39).  Let  us  assume  that  this 

(2) 

eigenvector  x  ,  say,  is  of  unit  length  and  the  corresponding  eigenvalue  for  A^ 
be  ^2.1'  '^us  at  the  second  stage,  we  have 
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Now,  since  Aq  and  A2  commute  and  also  Aj^  and  A2  commute,  every  vector  in  the 

(2)  (2)  2  (2) 

linear  mainfold  spanned  by  {x  ,A2X  ,A2X  is  an  eigenvector  of  Aq  correspond¬ 

ing  to  the  same  eigenvalue  X^q  and  also  is  an  eigenvector  of  A^  corresponding  to  the 

(3)  (3) 

same  eigenvalue  This  manifold  contains  an  eigenvector  x  of  A2.  Assume  x 

to  be  of  unit  length  and  Xj^2  the  corresponding  eigenvalue  of  A2.  Thus  we  have 

A  .  X 

AqX 

A^X»>  .  Xjjx«> 

AjX«)  .  Xj^x«). 

Continuing  this  procedure  for  every  n<w,  where  w  is  the  first  infinite  ordinal 
number,  we  find  a  sequence  x^^\  l_<n<w,  of  vectors  of  unit  length  and  a  sequence 
X  ,  0£k<w  of  real  numbers  satisfying  the  following  property: 


X  ,  x^  ^  0£k <  n. 


It  is  Important  to  note  that  once  an  eigenvalue  enters  into  the  system,  it  remains 

in  the  system  at  every  stage  of  the  induction  process. 

Since  each  x^"\  l_^n<w  is  of  unit  length,  by  compactness  argument,  this 

(w) 

sequence  admits  a  convergent  subsequence  converging  to  x  ,  say.  Obviously,  this 
vector  is  of  unit  length.  Further, 

(w)  (w) 

Aj^x''  for  Oj<k<w. 

(w)  (w)  2  (w)  I 

Now,  every  vector  in  the  linear  manifold  spanned  by  lx  ’^w* 

an  eigenvector  of  A^,  0^k<w,  corresponding  to  the  eigenvalue  X^j^,  0£k<w.  But 

, _ Axr-ij _ .--A _ _  _ _ _ (w+1) 


this  manifold  contains  an  eigenvector  x 


of  A  .  Let  us  assume  this  vector  to  be 
w 


of  unit  length  and  let  the  corresponding  eigenvalue  of  A^  be  X^^,  Thus  we  have 


-  •  IS.*  O  O  •  *  ►  *  n*  *.  •-*  •  ^  •  •  •  '  •  •  •  '  *\  * 
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(w+1)  (w+1) 

:  =  »  0_<k<w+l. 


This  process  is  continued  arguing  separately  for  the  case  of  limit  ordinals  and  the 
case  of  non-limit  ordinals. 

'  ot) 

Now,  by  compactness  argument,  x  ,  a <  admits  a  subnet  converging  to  a  vector 
of  unit  length.  This  vector  is  the  desired  one. 

Now,  we  claim  that  there  exists  a  vector  of  unit  length  such  that 

(2) 

and  z  is  a  common  eigenvector  for  each  A^,  0_<  a<  Q,  Let  X2Q  ^  eigenvalue  of 
Aq  admitting  an  eigenvector  y^^^  such  that  y^^^  is  of  unit  length  and  y^^^  1  z^^\ 

Let  0<  a<  Q.  We  claim  that  there  exists  a  vector  y^*^^  of  unit  length  and  real  numbers 
X^g.  0£6<a,  satisfying  the  following  properties. 

(i)  X2g  is  an  eigenvalue  of  Ag. 

(ii)  Agy^“^  =  every  0_<6<a. 

(iii)  y^“^  1 

(iv)  X„  ,  0 <  6 <  a  is  independent  of  a. 

^  p 

The  y^°'^'s  and  X-  's  are  obtained  by  transfinite  induction  as  follows,  At  the  first 

step,  for  a=  1,  we  have  y^^^  and  X2Q  satisfying  (i)  through  (iv) ,  Let  a*  2.  The 

linear  manifold  spanned  by  {y^^^A^y^^^A^y^^^ . . . }  contains  an  eigenvector  y^^^ 

for  Aj^  with  the  corresponding  eigenvalue,  say,  ^21'  Since  A^  and  A^^  commute,  every 

vector  in  this  manifold  is  an  eigenvector  of  Aq  corresponding  to  the  eigenvalue  ^20* 

(2) 

Without  loss  of  generality  we  can  assume  y  to  be  of  unit  length.  Further, 

(2)  (1)  _  ...  ,  ,  ,n  (1)  ,,  . 

y  1  z  .  To  prove  this,  consider  A^y  .  We  have 


Consequently,  every  vector  in  the  linear  manifold  spanned  by  {y^^\ A^y^^\ A^y } 
is  orthogonal  to  z^^\  Hence  y^^^  1  z^^\  Thus,  we  have  a  vector  y^^^  of  unit  length 


•_>  •  «'•  -*•»  i.'- ;  ■  j 

•  '  "luA  •.  “ 


V'-.S 


satisfying 


and 


L  •  . 

k"- . 

!.■■  . 

•v 

m 


This  process  is  continued  as  in  the  first  part  of  this  proof  noting  that  once  an 

eigenvalue  enters  the  system  it  remains  in  the  system.  By  compactness  of  the 

unit  ball  of  we  can  find  a  subnet  of  y^'*^  0^a.<  converging  to  a  vector,  say, 

(2)  (2) 

z  .  This  z  is  the  desired  vector. 


y- 

Thus, 

we  can  obtain  n 

properties 

i:: 

V. 

.  • 

(a) 

1  - 1,  i= 

(b) 

p 

{-r 

(c) 

A  ,(i)  .  X 

r , . 

Define  C  ■ 

z^2) 

\Z  ,z 

.Cl)  -C2) 


(n) 


C  is  the  required  orthogonal  matrix. 

Proof  of  Theorem  3;  By  Lemma  1,  there  exists  an  orthogonal  matrix  C“ 
such  that 

Ac  .  DUg{Xjy.X2y . X„y),  y.  T. 

where  X,  ,X.,  ,...,X  are  the  eigenvalues  of  A  .  Let  f . :  Y-^R  be  defined  by 
ly  2y  ny  y  1 

fiCy)  -  Xiy,  y*  T.  I-  1  to  o. 

T 

It  is  easy  to  check  that  each  f^  is  measurable..  For,  f^(y)  ■  AyZ^^\  a  linear 
combination  of  the  elements  of  A^.  Let  g^;  Y-^R  be  defined  by 


8i^y^ "  fT^  ^i^y>  ° 


if  fj^Cy)  “0,  ye  Y,  i*  1  to  n. 


obviously,  measurable  functions.  Now, 


A  -  C  Diag{f  (y),f»Cy),...,f  (y) }C^. 
y  i  ^  n 

Then  =  C  Diag{gj^Cy)  ,g2Cy) ,  - . .  ,g^(y)  }C*^  Csee  Rao  and  Mitra  1971,  p.  69). 
Consequently,  the  elements  of  A^  as  functions  on  Y  are  measurable. 

Now,  we  come  to  the  question  raised  In  (b) .  A^  as  a  function  of  y  need  not  be 
Integrable.  The  following  is  a  simple  example.  Let  Y  =  (0,1),  B  =  Borel  o-field  on 
Y,  u  “  Lebesgue  measure  on  8,  and  A^^  =  (y) ,  ye  Y,  is  of  order  1x1.  A^  as  a  function 
of  y  Is  Integrable  with  respect  to  u  but  A^  Is  not. 

The  following  result  generalizes  the  Inequality  expounded  In  Section  2  and 
answers  the  query  raised  In  (c) . 

Theorem  5  Let  R(A  )  be  the  same  for  all  ye  De  B  with  u(D)  ■  1.  Suppose  A  and  A^ 
-  y  '  y  y 

as  functions  of  y  are  Integrable  with  respect  to  u.  Then 


[ 


Ay  u(<iy )  ]  1 


Ay  y  Cdy) . 


Y  Y 

Proof:  Let  V  be  the  collection  of  all  positive  seml-deflnlte  matrices  of  the  same 


order  nxn  as  that  of  Ay  and  range  the  same  as  that  of  Ay,  ye  D.  Then  V  Is  a  closed 


convex  subset  of  an  appropriate  f Inlte-dimenslonal  Euclidean  space  and  the  map  y-^  A 


fromY  to  V  is  measurable.  By  Theorem  1,  the  map  A-*- a"*"  from  P  to  P  is  convex.  Let 

n  T  + 

C  e  R  be  an  arbitrary  but  fixed  vector.  Then  the  map  f:l?->-  R  defined  by  f(A)  ■  C  A  C 

is  convex.  By  Jensen's  inequality  (see  Ferguson  (1967,  p.  76)), 


f(EA^.j)  <  Ef(A^.j),  i.e.. 


c’^(  A  u(dy))‘^C  <  cVc  y(dy) 


c’^(f  y(dy))C. 


12 


This  Implies  that,  as  C  Is  arbitrary. 


(j  Ay  w(dy))'*’  <_  Ay  u(dy). 


This  completes  the  proof. 

The  condition  on  the  range  In  the  above  theorem.  In  a  certain  sense.  Is  necessary 
for  the  Inequlalty  to  be  valid.  If  the  above  Inequality  Is  valid  for  all  probability 
measures  for  which  the  concerned  Integrals  are  finite,  then  the  above  condlton 
on  the  range  Is  necessary. 

The  above  result  can  be  couched  in  the  language  of  random  matrices  as  follows. 
Corollary  3.  Let  A  be  a  symmetric  matrix  of  random  variables  such  that  A  Is  positive 
seml-deflnlte  almost  surely  and  RCA)  Is  the  same  almost  surely.  Assume  that  EA  and 


EA  exist.  Then 


CEA)'^<  Ea'*'. 


The  above  Inequality  Is  an  analogue  of  the  usual  Harmonic-Arithmetic  Inequality, 
namely.  If  f  Is  an  almost  surely  positive  random  variables  with  Ef  and  Ef  ^ 
finite  then  (Ef)  ^^Ef 

We  also  obtain  as  a  corollary  the  following  result  due  to  Groves  and  Rothenberg 
(1969,  p.  690).  See  also  Srlvastava  (1970,  p.  236). 

Corollary  4,  Let  A  be  a  symmetric  matrix  of  random  variables  such  that  A  is  positive 
definite  almost  surely,  and  EA  and  EA  ^  exist.  Then 

(EA)"^£EA"^. 

Corollary  5.  Let  Yj^,Y2, . . .  ,Yjj  be  a  random  sample  of  size  N  form  a  multivariate 

normal  distribution  with  a  singular  variance  covariance  matrix  Z .  Let  Y  be  the 

N  _  _  +  + 

sample  mean  and  S  ■  J!  (Y.-Y)(Y.-Y)  .  If  r  ■  rank(E)  and  N>  r,  then  (ES)  ^E(S  ). 

^  _  4  X  X 


Proof ;  It  is  known  that  R(S)c  RCS)  and  rankOS)  ■  rankCl)  with  probability  1  when  N> 
Hence  R(S)  ■  R(I)  almost  surely.  The  result  now  follows  from  Corollary  3, 
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